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Introduction 

Two decades after the report “A Nation at Risk” by 
National Commission on Excellence in Education (A Nation at 
Risk: The imperative of educational reform, 1983), education 
professionals are still struggling with the issue of improving 
academic achievement as measured by standardized test scores. To 
reinforce the sense of national urgency about this issue, Tbe 
Teaching Commission (2004) published a new report, “Teaching 
at Risk”, stating that teaching quality is a critical factor in attempts 
to improve our national’s global competitiveness, security and 
future. Whether there is any association between teaching quality 
and the nation’s ability to compete in a global economy is an 
empirical question that should be addressed in a the context of 
carefully defining teacher quality. 

Purpose 

Purpose of this article is to examine the issue of the 
relationship between teacher effectiveness and students’ 
achievement as measured by test scores. A strong belief among 
policy makers and public as well as private funding agencies is that 
test scores are directly related to the quality of teaching 
effectiveness (Kupermintz, 2002). This relationship implies that 
there could be a direct causality among teacher preparation, teacher 
quality, and student achievement. The terms “teaching 
effectiveness” and “teacher effect” are often used interchangeably 
in these conversations. In the following sections, we will discuss 
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several aspects of each construct. Particularly, we discuss the 
following issues: (1) teacher effects, (2) teaching or teacher 
effectiveness, and (3) an educational model of school and teacher 
effects on student achievement. Fundamental research issues and 
concerns as well as an alternative conceptual framework for 
studying the relationship of achievement and teaching will be 
highlighted. 


Comparing Teacher Effects 
and Teacher Effectiveness 

In recent years, research on effectiveness of teaching has 
reported a direct relationship between its quality and student 
learning (Darling-Hammond & Young, 2002). Odden, Borman, 
and Fermanich (2004) indicated that teachers have a significant 
influence on student learning. However, the definition of teaching 
effectiveness is not clear and, in fact, is operationalized in terms of 
teacher effects, which are more easily quantified in research 
studies. Based on the literature discussion by Odden, Borman, and 
Fermanich (2004), the following teacher factors or effects are 
specifically identified. They were found to be, to different degrees, 
associated with student achievement and include: (1) years of 
teaching (Goldhaber & Brewer, 1997), (2) major of undergraduate 
study, particularly for mathematic and science teachers (Monk, 
1994), (3) ACT or SAT test scores (e.g., Ferguson, 1998), (4) 
course work or degree obtained (Rowan, Chiang, & Miller, 1996), 
(5) quality of high school (Goldhaber & Brewer, 1997), (6) earning 
of a license (Darling-Hammond & Young, 2002), and (7) verbal 
ability (Ehrenberg & Brewer, 1995). Odden et al. (2004) suggest 
that these variables should be defined further, especially for the 
variables that show mixed effects. 

Whereas these teacher effects can be defined relatively 
easily and studied, the teacher effectiveness is a very different 
matter. While the teacher effects can be operational zed as, for 
instance, the gender, experience and salary level of teachers, the 
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operationalization of teacher or teaching effectiveness is not clearly 
articulated. For example, it is relatively a simple matter to study the 
relationship between teachers’ salary and student achievement as 
a teacher effect since there is a large variation in teachers’ salary. 
One could conclude, therefore, that students taught by higher paid 
teaches will be more successful on tests than pupils of lower paid 
teachers. Flowever, such a teacher effect cannot be necessarily 
translated into teacher effectiveness; that is, a teacher’s salary may 
not have anything to do with whether a teacher is effective in 
his/her teaching. The concept of teaching effectiveness needs to be 
clearly articulated and defined before its relationship with other 
factors (e.g., years of teaching) can be empirically verified without 
ambiguity. 

It is imperative to clearly differentiate tbe concepts of 
teacher effects and teacher effectiveness. Such a difference is not 
merely a semantic or rhetorical matter. Rather, it has a great 
implication for research on teachers and teaching practices as well 
as on the policies related to teachers in the current education reform 
effort. Misuse of these two concepts may lead to great simplicity in 
terms of how we consider teacher effectiveness and efforts to 
improve student achievement. A teacher may have less experience 
in teaching but she/he could be very effective in teaching. 
Conversely, a teacher who might have solid content knowledge 
might be a very ineffective teacher. In a way, viewing from the 
perspective of latent variable analysis framework, teacher effects 
are observable variables such as gender or salary level. The teacher 
or teaching effectiveness is a latent variable, which needs to be 
operationalized by using proxy measures. For example, one could 
operationalize teaching effectiveness in terms of response to a need 
the student feels or the student involvement in identifying his/her 
learning needs and outcomes. Therefore, we argue that there is a 
great danger in equating teacher effects with teacher effectiveness 
since a teacher effect, such the type of college degree, does not 
always translate into instructional effects. The latter construct may 
have little to no impact on student achievement. Such 
misunderstandings of teacher effects and teaching effectiveness can 
lead to inappropriate conclusions that have direct impact on 
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professional development strategies, on teacher preparation 
program content, and on professional judgment. 

If teacher or teaching effectiveness is conceptually 
different from teacher effect, what is teacher effectiveness? Are 
there any empirical studies that investigate the link between teacher 
effectiveness and student learning? 

Literature Review 

Evidence of teaching effectiveness 

Many studies and articles have claimed that there is a 
relationship between teacher effectiveness and students’ 
achievement. Generally, teacher effectiveness or effective teaching 
has been characterized in terms of specific teaching practices (e.g., 
Kemp & Hall, 1992; Taylor, Pearson, Clark, & Walpole, 1999). 
For example, an effective teacher would employ systematic 
teaching procedures (Kemp & Hall, 1992) and spend more time 
working with small groups throughout the day (Taylor et al., 1999). 
Porter (2002) found that pupils make more academic gains when 
instruction is effectively connected to assessment. Clearly, teacher 
effectiveness or effective teaching can be operationalized in 
different ways but they are much less straightforward than the 
measures of “teacher effects.” 

Empirical Data 

Sanders and his associates (1996, 1997, & 2000; Rowan et al., 
1996; Webster, Mendro, Orsak, & Weerasingbe, 1997) analyzed 
data from tbe Tennessee value-added assessment system. Tbe 
research used mixed-modeling to conduct longitudinal analyses of 
student achievement to make estimates of school, class size, and 
teacher effects. Data from these studies seems to support the claim 
that the most important factor influencing student learning is the 
teacher. The researchers offer the definition of “teacher 
effectiveness” as the characteristics that seem to be identical to 
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“teacher effects,” such as effects of classroom size and spending 
differences. Summarizing from the studies, Sanders (2000) stated: 
“differences in teacher effectiveness is the single largest factor 
affecting academic growth of populations of students” (p. 8). 
Wright, Horn, and Sanders (1997) stated: “Effective teachers 
appear to be effective with students of all achievement levels, 
regardless of the level of heterogeneity in their classrooms. If the 
teacher is ineffective, students under that teacher’s tutelage will 
achieve inadequate progress academically, regardless of how 
similar or different they are regarding their academic achievemenf ’ 
(p. 23). However, what seemed to be missing in these analyses was 
the most important factor — defining “teacher effectiveness.” The 
study reported the regression coefficients for teacher variable, 
which was the most significant variable in the model for predicting 
a gain score between two tests. But the studies did not clearly 
define teacher effectiveness, nor did the studies indicate what the 
general notion of "teacher variable" meant. In addition, the studies 
hypothesized the relationship between teacher effectiveness and 
student gain, but what teacher effectiveness indicated was unclear 
and not defined. Thus, their claim about teacher effectiveness and 
student achievement could not be supported by the data. 

Similar problems exist for other empirical studies in 
analyzing such a relationship. For example, the data from the study 
by Mendro, Jordan, Gomez, Bembry, and Anderson (in press) on 
long-term teacher effects on student achievement failed to support 
their conclusions on long-term effects of teacher effectiveness. As 
in the study by Wright et al. (1997), there was no operational 
definition of what teacher effectiveness was, although the term 
“teacher effectiveness” was used. It was not clear from their 
analyses what the long-term effects were and how the teacher 
effectiveness, if it were defined at all in some way, linking the 
constructs of teacher effectiveness and student achievement was 
connected to the students' achievement. 
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Thus, the relationship between teacher effectiveness and 
student achievement needs to be further examined carefully. 
Although there is a theoretical basis for such a relationship, the 
evidence is far from convincing. In addition, the data on teacher 
effectiveness are often affected by uncontrolled and complex 
variables unrelated to schools, pupils, and the teaching act. Even 
teacher effect variables, such as the higher education institutions 
from which teachers graduated, are not often provided to 
researchers by the universities or schools. Thus, before making any 
policies regarding teachers (e.g., teacher salary) based on student 
achievement gain, especially a long-term gain (e.g., over entire 
elementary school, middle school, or high school), more study is 
necessarily to fully examine the issues involved. 

Multilevel Interactive Education Model 

Odden (2004) suggests a multilevel educational model to 
study teaching effectiveness and its relationship to student 
achievement on tests. The goal of this model is to estimate the 
effect of a particular variable as one of several variables included 
in a multilevel analytical and nested model of school, teacher, and 
student. Their multilevel educational model is duplicated here in 
Eigure 1 and such a model can be analyzed via multilevel analysis 
(Raudenbush & Bryk, 20(^). ^ 
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Figure 1. Educational model of school and classroom effects on student learning gains 
proposed by Odden et al. 


Whereas this is a useful model in studying effects of school 
and classroom on student learning, especially from the multilevel 
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analytical perspective, one major flaw is that it does not clearly 
define teacher effectiveness and how teacher effectiveness interacts 
with other variables such as teacher characteristic variables. In 
addition, the model does not explicitly articulate the interaction 
among school, teacher, and student. That is, the model ignores the 
active role the students and their family and community play. 
Learning and motivation theories have suggested that learning is a 
dynamic process in which learners and instructors are highly 
interactive and connect new concepts to those previously 
understood (Vygotsky, 1978). 

The findings from these studies support the idea that 
student learning is an interactive process in which student 
characteristics do influence the outcomes of their own learning. In 
other words, effective teaching is conditioned on student 
characteristics, just as the student learning is conditioned on the 
effective teaching. The effort to search for one-size-fit-all kind of 
teaching effectiveness, regardless of the student characteristics, is 
of questionable value to educators and students. 

Although effective teaching is fundamental to learning, 
over emphasis on the importance of teaching methodology in the 
process of learning may imply that we should ignore the dynamic 
learning process in which students are the significant players, not 
just teachers. For example, a study conducted by Milanowski 
(2004) analyzed teacher performance and student achievement. 
The researcher found that when the student characteristics are 
ignored in the analysis, the degree to which students do better or 
worse than expected depends on the prior learning level of the 
student. 

Just as a patient’s quality of health is a characteristic 
affected by many complex and interrelated variables and cannot be 
entirely attributed to the type and quality of a physician’s medical 
practice, student achievement is a result of a variety of factors. 
These can include teacher effects, teacher effectiveness (when 
clearly defined), student motivation, parental involvement, funding, 
the work and dispositions of all involved and quality of leadership 
of school administrators. 
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Based on our arguments regarding the importance of 
dynamic learning processes between students and teachers, we 
propose a “multilevel interactive education model.” This model 
includes all the components proposed by Odden et al. (2004) in 
tbeir multilevel educational model, but it also explicitly articulates 
tbe dynamic nature of learning process. This model is depicted in 
Figure 2. In addition, it differentiates teacher effects from teacher 
effectiveness, and it holds students, teacher, and school equally 
accountable for the student learning. For example, if a student of 
low SES fails to meet adequate yearly progress while his/her 
non-low SES counterparts do not, we need to address the issues of 
student characteristics rather than primarily attributing success or 
failure t o the quality of classroom instruction . That is, we need to 
know more about tbe le yning needs of tliis. particular s tudent 
before ^ solely focus on^he change of reaming methods, which 
may inadvertently have negative influence on rest of the students. 
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Figure 2. Multilevel dynamic education model of school, teacher, and teacher 
effectiveness on stndent learning 

The proceeding model could be used as a framework for various 
studies. Research using the dynamic education model in Figure 2 
could focus on interactive processes of student learning and could, 
particularly, examine the effects of teacher effectiveness as well as 
teacher effects, respectively. Ignoring the interactive learning 
processes between teacher and student may results in futile effort 
of improving student learning. Over emphasis on the teachers’ role 
in student learning may lead to disappointing findings. The 
inconsistent results from study by Kimball, White, Milanowski, and 
Borman (2004) with respect to the question of whether teachers’ 
evaluation scores were associated with student learning may 
suggest that the teachers of one-size-fit-all are not all things to all 
students. Teacher effectiveness is conditioned on the student 
characteristics. Only when we recognize the importance of 
students’ role in their own learning, can we meaningfully address 
the issues related to teacher effectiveness and teacher effects. 
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